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The work describes curricular modification to a physical science content class for elementary edu- 
cation majors at Winona State University [a regional comprehensive university]. The modification, 
the regular use of Cognitive Acceleration materials to develop student reasoning ability, produces 
unusually high gains on Lawson's Classroom Test of Scientific Reasoning. 



INVESTIGATIVE SCIENCE AT WINONA 
STATE 



Elementary Education majors at Winona State Uni- 
versity [a regional comprehensive university] take two 4- 
credit courses in science to fulfill their general education 
laboratory science requirements. The courses. Investiga- 
tive Science 1 & 2, cover licensing standards in concep- 
tual Physics, Chemistry, Earth Science, and Biology. The 
courses are formulated to present science content in the 
way we hope our children are taught at the elementary 
level: always in the lab, always experiencing data before 
learning formal concepts, and always coming to consen- 
sus about the meaning of data through group discussion 
and metacognition. The approach is meant to reduce 
trepidation toward science by providing experience with 
inexpensive activities which can be easily done in the 
students' future classrooms. 

The courses arc taught by a mix of faculty from across 
the college of science and engineering. While not a 
new approach to teaching introductory science, [1-5], the 
classes, run regularly for the past 7 years, have been suf- 
ficiently successful to be the required science classes for 
elementary education students on campus. 

Historically, our progress in teaching this course has 
been measured with internally developed content exams 
and also by Anton Lawson's "Classroom Test of Scientific 
Reasoning," (CTSR) [6], a multiple choice instrument 
which suggests a student's Piagetian reasoning level. The 
CTSR has been shown to be a meaningful predictor of 
success on learning measures in physics, such as the Force 
Concept Inventory [7] . The measure quantifies old suspi- 
cions about our students, [8], and in general, we consider 
gain on the CTSR an indicator that the course is chang- 
ing, for the better, the way our prc-service teachers think 
about the world. 
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II. THE CLASSROOM TEST OF SCIENTIFIC 
REASONING 



The CTSR is a 24 item test that is graded out of 13 
points, as most of the questions are paired in the style of 
"Given this situation, what will happen?" and "Why?" . 
Students must get both parts of each pair correct to score 
a point, and the measure is accordingly quite difficult. 
Scores of 0-4 correspond to concrete reasoners, 5-10 tran- 
sitional reasoners, and 11-13 formal. The transitional 
period is often broken into early (5-7) and late (8-10) 
transitional reasoning groups. For an overview of these 
reasoning levels, see [9]. 

As children advance through primary school, the top- 
ics and skills discussed move from concrete operations 
(eg "What does the letter 'A' look like?", "How many 
words are in this sentence?") towards formal logical op- 
erations (eg "Are all squares also rectangles?", "Where 
in a sentence does the verb go?", "Why are many of a 
bird's bones hollow?" , "If a chicken has 4 fingers, is their 
number 10 the same as our number 10?"). If a teacher 
lacks the ability to reason formally, it is likely that they 
have always learned science by memorization. It is un- 
reasonable then to expect such a teacher to ever fully 
address the "why" part of a scientific explanation ade- 
quately without communicating the model building and 
testing ability that building an effective scientific expla- 
nation requires. 

According to the psychologist Jean Piaget, [10], stu- 
dents should begin to transition to formal reasoning (i.e., 
the students don't require a physical object in front 
of them (concrete reasoning), but instead are capable 
of performing thought experiments (formal reasoning)) 
around the age of sexual maturity, age 11 in girls and 12 
in boys. Our local measurements with the CTSR sug- 
gest that either Piaget was optimistic or standards have 
slipped, sec Table I for example scores from one of the 
author's (Moore's) classes. These data corroborate with 
many other studies that have found relatively small per- 
centages of students that have acquired formal reasoning, 
[11] 

Historically speaking, according to this measure only 
a modest fraction of students in the education program 
enter as formal reasoners. This reasoning ability is neccs- 
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sary if students arc going to sum the forces on the interna- 
tional space station, imagine the motion of N2 molecules 
within a balloon, or hypothesize about the effect of a 
drug on a population of bacteria. Our fields quickly re- 
duce to a set of disconnected rules and special cases for 
the students so lacking. Further, the ability to create 
a controlled experiment (hypothetical-deductive reason- 
ing, for example "if-and-thcn-therefore" statements) is 
very difficult for students not at the "formal" reasoning 
level, [12]. It should be apparent that future teachers 
must be equipped with these skills. 

As mentioned, table I lists CTSR pre-scores and gains 
for a number of classes at Winona State University. At 
present, the authors are aware of no published normal 
distributions of score or gain for reformed/traditional 
science classes on this measure. Locally, it seems that 
a "typical" gain on the measure is about 1 point, and 
apocryphally, many science classes show gains of zero. 
This may seem odd, but the CTSR "measures" scien- 
tific reasoning ability, which develops either in response 
to stimulation or as a part of normal maturation, which 
recently has been observed to be delayed [13]. 



III. COGNITIVE ACCELERATION 
INTERVENTIONS 

At the middle school level, Philp Adey, Michael Shayer, 
and Carolyn Yates have developed supplementary lessons 
which stimulate the development of reasoning ability, 
[14]. Their results in the field of "Cognitive Acceler- 
ation" over the past twenty years are, without hyper- 
bole, tremendous, [15], and have culminated in a series 
of curricular interventions appropriate for students in US 
grades K-6. The original series of Cognitive Acceleration 
interventions, "Thinking Science," [14], are a series of 
30 "intervention lessons" which are designed to be used 
with 11-14 year old children. The lessons are intended 
to be inserted into the regular curriculum at the rate of 
once every week or two over a period of about one to 
two years. They are specifically designed to create the 
cognitive confiict which stimulates the development of 
students' reasoning ability. The specific skills targeted by 
the materials are: control of variables, classification, ratio 
and proportionality, inverse proportionality and equilib- 
rium, probability and correlation, and the use of abstract 
models to explain and predict. For further discussion of 
the material's effect in the classroom, see [15, 16]. 



IV. EXPERIMENT AND RESULTS 

In the Spring 2011 semester, one of the authors, Moore, 
taught a section of Investigative Science 1, which dis- 
cusses ideas from Physics and Chemistry. Having re- 
cently become aware of the Cognitive Acceleration ma- 
terials, he taught the class with the normal curriculum, 
with one small modification. Each weekend, students 



Investigative Science 




average 


average 


Semester 


N 


pre CTSR CTSR gain 


Spring 2008 


26 


5.5 


1.3 


Spring 2009 


26 


5.9 


0.8 


Spring 2011 


28 


6.4 


2.2 


University Average 


160 


6.25 


1.13 


College Physics 








Summer 2009 


32 


8.7 


1.0 


Summer 2011 


26 


8.4 


1.5 


Fall 2009 


11 


7.5 


1.8 


Fall 2010 


19 


7.5 


1.2 



TABLE I: Typical results from Lawson's "Classroom Test of 
Scientific Reasoning", administered at Winona State Univer- 
sity. Except for the WSU average listed, all results posted 
are those of the author (Moore). The WSU average gains in 
Investigative Science do not include the Spring 2011 class, the 
difference being the motivation for this work. The N given 
is the number of students who were present to take both pre 
and post tests, and class averages are taken only over students 
with a complete pre/post pair of scores. The Spring 2011 sec- 
tion made use of half of the "Thinking Science" lessons, which 
are designed to stimulate the development of reasoning ability 
among middle school students. As can be seen from the data, 
they are also appropriate for use among college students. 



worked through one "Thinking Science" lesson, [14, 16], 
with (substantially metacognitive) discussion on the fol- 
lowing monday. Students were directed to work through 
the lesson as students. Further they were also to iden- 
tify the main learning goal or outcome from the lesson 
and create additional activities aligned with the lesson, 
to be used if the pupils they were working with finished 
early. Students were also asked for written reflections 
on the nature of the learning in each lesson. The long- 
term goal for the effort was for this class to be able to 
facilitate Thinking Science lessons with a group of 5th 
grade students, which sadly because of logistics, didn't 
materialize. 

Over the course of the semester, the pre-service ele- 
mentary teachers were affected by the lessons. Terms 
from the materials, like "fair test" from the control of 
variables lesson, regularly began to appear in normal 
class discussions outside of the time allotted to Thinking 
Science. In addition, in the time devoted to Thinking Sci- 
ence materials, student resistance to work on the lessons 
lessened as the semester progressed. Group and class dis- 
cussions became more in depth throughout the semester 
(at the beginning they would provide one word answers 
and try to get it over with). This was a remarkable result, 
as historically this specific population has been the least 
willing to embrace the identity and practice of scientists. 

The most substantial result from the intervention is 
the gain in CTSR score of about 2.2 over the course of 
the semester. This is roughly double the normal increase 
seen in students of this ability and college major. If this 
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increase can be sustained in further sections of Investiga- 
tive Science, it will be a powerful addition to the curricu- 
lum. 

V. CONCLUSION 

The gains in CTSR score described in this work, which 
came as a direct result of student exposure to Thinking 
Science interventions, should be seen as compelling evi- 
dence that CTSR score (and implicitly, reasoning ability) 
can be affected by classroom practice. When training fu- 
ture educators, reasoning ability must be targeted for 
improvement, as teachers are not able to communicate 
material beyond their own level of intellectual sophis- 



tication. The Thinking Science materials are one way 
to increase this critically important ability. It would 
be interesting to know if the Thinking Science interven- 
tions described in the work have a similar impact on 
other populations with immature reasoning ability, for 
example, underprepared students in University (calculus- 
based)Physics. 
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